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Integral Action in Output Feedback 
for multi-input multi-output nonlinear systems 

Daniele Astolfi and Laurent Praly 


Abstract —We address a particular problem of output regula¬ 
tion for multi-input multi-output nonlinear systems. Specifically, 
we are interested in making the stability of an equilibrium point 
and the regulation to zero of an output, robust to (small) un¬ 
modelled discrepancies between design model and actual system 
in particular those introducing an offset. We propose a novel 
procedure which is intended to be relevant to real life systems, 
as illustrated by a (non academic) example. 

Index Terms —Robust regulation, nonlinear control, output 
feedback, semi-global stabilization, integral action, observability, 
high-gain observer, forwarding, non-minimum phase systems, 
uncertain dynamic system. 

I. Introduction 


The approach to nonlinear output regulation followed in this 
paper is motivated by the linear context developed in its full 
generality in the milestone paper ifT^ that we find useful to 
briefly recall here. Consider the linear system 

X = AoX + BqU, _(yr\_(Co^r\ 

y = Cox, y- {yej - \Co,ej'"’ 

where the state x is in R", the control u is in K"* and the 
measured output y is in MP. The output y is decomposed as 
y = {yr,ye) where in R’', r < m, is the output to be 
regulated to zero (without loss of generality). When the system 
above is supposed to be only an approximation of a process 
given by 


For a controlled dynamical system, it is of prime importance 
in real world applications to be able to design an output 
feedback control law which achieves asymptotic regulation of 
a given output while keeping the solutions in some prescribed 
set, in presence of (constant) uncertainties. We refer to this as 
the problem of robust output regulation by output feedback. 

The problem has been completely solved in the linear 
framework by Francis and Wonham in the 70’s (see HI). 
Important efforts have been done in order to extend this result 
to the nonlinear case (see, for instance (3, ODl ) and many 
different solutions have been proposed (see among others cni, 

El, EH, m, a Chapter 7.2], Q, El, d, ED, ED, 
ED). Nevertheless we are still far from having a complete 
solution to the problem of output regulation in the nonlinear 
multi-input-multi-output framework similar to what we have 
in the linear case. Indeed most of the works require a good 
knowledge of the effects of the disturbances on the system, 
or they rely on “structural properties” as, for example, normal 
forms, minimum phase assumption, matched uncertainties or 
relative degree uniform in the disturbances. In particular, for 
single-input single-output minimum-phase nonlinear systems 
which possess a well defined relative degree preserved under 
the effect of disturbances, a complete solution has been given 
in ll24l . further improved to the output feedback case in ll^ . 
Under the same assumptions, this work has been successfully 
extended in llJTll to square multi-input multi-output systems for 
which the notion of relative degree indices and observability 
indices coincides. Further, with the technique of the auxiliary 
system introduced in ||20|, the minimum-phase assumption 
has been removed in ll28l allowing the zero-dynamics to be 
unstable. However, as far as we know, a general solution is 
still unknown when these structural properties do not hold. 
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X = Ax -f Bu -f Pw , _ f yr\ 

y = Cx + Qw, y ~ \ye) 



w, 


where w is an unknown constant signal to be either rejected 
or tracked, the well posed regulator problem with internal 
stability (addressed by Wonham for linear systems as shown 
for instance in ll44l Chapter 8]) is that of finding an output 
feedback law based on the model such that, for all triplets 
{A, B, C} close enough to {^Iq, Bq, Cq}, and for all matrices 
pairs {P,Q}, the regulation-stabilization problem is solved, 
i.e. the system admits a stable equilibrium point on which 
the output to be regulated is equal to zero. According to ||9] 
Proposition 1.6], for example, this problem is solvable if and 
only if the following 3 conditions are satisfied: 

(a) the pair {Ao,Co) is detectable; 

(b) the pair {Aq,Bq) is stabilizable; 

(c) the matrix ( ] is right invertible. 

\Uo,r P / 

Precisely, under the above 3 conditions, it is always possible 
to design an output feedback law of the form 


z = yr 
i) = Fr] -f Ly 
u = Ki]-\-Mz-\-Ny 

which solves the regulation problem provided F, L, K, M, 
and N are chosen such that the following matrix 

(A F BNC BK BM\ 

\ LC F 0 

\ a 0 0 y 

is Hurwitz for all triplets {A, B, C} close enough to 

{Ao,Bo,Co], and for all matrices pairs {P,Q}, Note that 

in this linear framework no structural properties are needed. 

Merging all the tools in literature that are at our disposal, 
we try to recover the same result as in the linear case, asking 
for possibly minimal assumptions but at the same time paying 
particular attention to proposing a design truly workable in 
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applications. For example, minimality implies not to ask for 
any specific structural properties whereas applicability forbids 
nonlinear changes of coordinates when no expression is known 
for their inverse. Our answer to the problem uses “bricks” 
which can be found in other publications (as m, 123,0) 
that we glue together. But for making this glueing process 
efficient we have to address some (new) specific problems. 

As in the linear framework, we extend the system with an 
integral action. Then, as in 133 . we rely on forwarding to 
design a stabilizing state feedback for the extended system. 
Next, for transforming this state feedback into an ouput 
feedback, it is sufficient to apply the techniques which have 
been proposed for asymptotic stabilization by output feedback. 
A lot of effort has been devoted to this question and many 
results have accumulated (see for instance the survey 0). In 
particular the transformation is done by replacing the actual 
state by a state estimate provided by a tunable observer (i.e. 
an observer whose dynamics can be made arbitrarily fast). 
Stability of the overall closed loop system is established via the 
common separation principle 1^ . 0, and output regulation 
follows from the integral action embedded in the control law. 

The tunable observer we propose is, as in 0 (previously 
inspired by m and 12911 ). a high-gain observer written in the 
original coordinates and appropriate for our multi-input multi¬ 
output (possibly non-square) case. We propose a new set of 
sufficient conditions which guarantees the existence of such an 
observer. As opposed to what we have found in the literature 
(see for instance |[8], ITTI . ITSlI ) our conditions can be verified 
in the original coordinates and they do not need the explicit 
knowledge of the inverse of nonlinear change of coordinates 
(which may be very hard to find). Also in looking for minimal 
assumptions, we do not ask for global observability or global 
uniformity with respect to the inputs. The latter impacts the 
state feedback design and we show how to address this point 
(in 133 only a global solution is proposed). 

Finally, we show that the proposed solution guarantees 
robust regulation. Robustness is here with respect to unmod¬ 
elled effects, not in the system state dimension, but in the 
approximations of the functions which define its dynamics 
and measurements. This has been done already in 1^ but 
for the state feedback case and with an assumption on the 
closed loop system. Here we show that if the model is close 
enough (in a sense), in open loop, to the process, then 
output regulation is achieved by our output feedback design. 
However, as opposed to the linear case, where the result is 
global with respect to the magnitude of the disturbances, an 
unfortunate consequence of being in our less restrictive context 
is that we need the perturbations to be small enough. 

In this work, to simplify, we restrict our attention to systems 
affine in the input. The extension to the non affine case is made 
possible by considering the system controls as state and their 
derivatives as fictitious controls. See m for example. 

The paper is organized as follows. Section |II] is devoted to 
show the main assumption and results of this work. In Section 
imi and |IV] we present respectively the state feedback design 
and the observer design. The proofs of the main propositions 
are given in Section |V] Finally, in Section |Vl] we illustrate the 
proposed design with a non-academic example inspired from a 
concrete case study in aeronautics (the regulation of the flight 
path angle of a simplified longitudinal model of a plane). 


Notations 

For a set S, S denotes its interior, dS denotes its boundary 
and d{x, S) denote the distance function of a point x to the 
set S. When S' is a subset of ,4 x 13 whose points are denoted 
(o, b), {S)a denotes the set {a e : 36 £ S : (a, 6) £ S}. For 
a function h and a vector field f,Lf denotes the Lie derivative 

dh 

of h along /, given coordinates x, Lfh{x) = —{x)f{x). To 
any strictly positive real number v, we associate a “saturation” 
function sat„ defined as a function bounded by v and 
satisfying 

V 

sat^(s)=s if |s| < —— , (1) 

1 + ^ 

where is a (small) strictly positive real number. 


H. Robust Regulation by Output Feedback 
A. Problem Statement and Assumptions 

For a process, we have at our disposal the following 
dynamical model 

X = f{x) + g{x)u, y = h{x) = {hr{x),he{x)) (2) 

where the state x is in R", the control u is in K™, the 

measured output y is in and the functions / : R” —>■ R”, 

p : R” —^ R"™ and 6, : R" —>• R^ are smooth enough and 

/ and h are zero at the origin. We investigate the problem 

of regulating at zero the part of the output y decomposed 
as y = {yr,ye) with G and r < m and this while 

stabilizing an equilibrium for x. But, being aware that the 
triplet (/, y, h) gives only an approximation of the dynamics 
of the process, we would like the above regulation-stabilization 
property to hold not only for this particular triplet but also for 
any other one in a neighborhood. 

The real process is described by equations of the form 

x = i{x,u), y = ({x,u), (3) 

where the functions ^ : R" x R™ —R" and ^ : R" x 
R™ -I- RP are assumed continuously differentiable (C^). 
These functions are unknown but we assume that they are 
close enough to f + gu and h respectively in the sense that 
the discrepancies 

\^{x,u) - f{x) - g{x)u\ + \C{x,u)-h{x)\ 


are small enough as made precise later on. 

Mimicking the 3 necessary and sufficient conditions for 
the linear case given in the introduction, we consider the 
following (sufficient) assumptions that we discuss after their 
formal statement. 


Assumption 1 There exists an open set O of R" containing 
the origin and an open star-shaped subset lA of R™, with the 
origin as star-center, such that, for any strictly positive real 
number u and any compact subset € of O, there exist an 
integer d, a compact subset of O, a real number U and a 
class-lC°° function a such that, for each each integer k, we can 
find functions '■ R"* xR ^xO ^ O, ■ 0x0 ^ R >07 
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a continuous function ; O —>■ M>o and a strictly positive 
real number such that: 

1. for any function t u{t) with values in U(u) defined as 


U{u) = {u GU : |m| < u} 


(4) 


and any bounded function t —> y{t), the set £ is forward 
invariant by the flow generated by the following observer 

XK.="d^{y,Xi^,u) ] (5) 

2. 'i{x,x)GOxO, Uk.{x,x) = 0 X = X ] 

a(|a; - a;|) < Uf^{x,x) < af.U (6) 

Vx S £ , Vx G £ ; 

4. lim (Tk = +00 ; (7) 

K—^OO 

dU, 


5. 


dx 


■{x,Xf,)[f{x)+g{x)u] 

dUn 

+ ^::-^{x,x^)'0Kih{x),x^,u) < -a^Ui^{x,x^,) 


( 8 ) 


Vu G K{u), V {x, Xk) G £ X £ . 
6. For all {ya,yb,XK,u) in x O x U{u), 

\'dK.{ya,XK.,u) -■di^{yb,x^,u)\ < L^^{x^)\ya-yb\ (9) 


Assumption 2 There exist an open subset S of R” and a 
continuous function /3 : S ^ hi which is zero at the origin and 
such that the origin of © with u = P(x), is an asymptotically 
and locally exponentially stable equilibrium point with S as 
domain of attraction. 


Assumption 3 The matrix 

(&) sWA 

is right invertible. 


( 10 ) 


Assumption [T] is aimed at being a counter-part of the 
detectability condition (a). But we have to face here problems 
specific to this nonlinear framework; 

• In our construction we shall rely on the so called sepa¬ 
ration principle. For nonlinear systems (see 1391 for ex¬ 
ample), it asks for an observer with a tunability property, 
i.e. an observer the speed of convergence of which can 
be made arbitrary fast (see fT)). This property is provided 
here by the family of observers 0 satisfying 0, 0 and 

O. 

• Observability may depend on the input. This explains why 
we impose the control to belong to the set U. 

■ The tuning of observers for non linear systems may de¬ 
pend on the local Lipschitz constant of the non linearities. 
This explains why the family of observers depends on the 
bound u of the input. 

On the other hand, to reduce the restrictiveness. Assumption 
[T] is imposed only for system states belonging to an open 
subset O of R". In Section |IV] we shall see how the family 
of observers in this assumption can be designed as observers 
based on high-gain techniques. 

Assumption |2] is the counter-part of the stabilizability con¬ 
dition (b) and claims the existence of a state feedback law 


which asymptotically stabilizes the system ©. Actually it 
assumes that a preliminary design step can be done. For it 
any tool - Lyapunov design, feedback (partial) linearization, 
passivity, use of structure of uncertainties in combination 
with gain assignment techniques, etc. - can be exploited. 
However, because Assumption [T] imposes the control be in 
U, we propagate this restriction here, asking the stabilizing 
control /3 to take values in that set. On the other hand, we can 
cope with having an arbitrary domain of attraction S, no need 
for it to be the full space or any arbitrarily large compact set. 

Finally Assumption [3 corresponds to the non-resonance 
condition (c) and states that the first order approximation at 
the origin of the system 0 does not have any zero at 0. 


B. Main results 

Assumptions 1 to 3 are sufficient to guarantee the existence 
of an output feedback law solving the regulation-stabilization 
problem for the model. 


Proposition 1 Suppose Assumptions [7] \2\ and |5] hold. There 
exists an open subset SO of (500) x R’' such that, for any of 
its compact set C^z, there exist an integer ^ a compact subset 
Cx ofO, a real number y and functions k : R" x R*" —> R*" 
and ipsat '■ R" X R’’ —>■ U{y), such that the origin of the model 
in closed-loop with the dynamic output feedback 

Z = k{x,hr{x)) , X = 'df,{y,X,u) , U = 'fsat(,X,z) (11) 

with K > is asymptoticall'^ stable with a domain of 
attraction A containing the set Cx x Cxz- 

Proof: See Section IV-AI ■ 

In the case where S and O are the full space R”, this result 
would be a semi-global regulation-stability result. It claims the 
existence of a dynamic output feedback which asymptotically 
stabilizes the origin of the model ©. Such a result is not new 
per se. It is in line with many results related to the separation 
principle as those in 1391, 0 or HU Chapter 12.3]. 

But as written in the introduction, we do not state only 
“existence” but instead we propose an explicit and workable 
design. We refer the reader to Section |III] for the definitiorQ 
of the set SO, the real number y and the functions k and ipsat 
and to Section IV-AI for the definitiorQ of the integer k and the 
set Cx . 

In the following propositions, under the Assumptions [1] 
and 13 and knowing the result of Proposition [T] holds , we 
study the process @ in closed-loop with the control law (fTTT l 
designed for the model ©. 


Proposition 2 Let C be an arbitrary compact subset of the do¬ 
main of attraction A given by Proposition\J\ which admits the 
equilibrium as an interior point and is forward invariant for 
the closed-loop system ©,(123. For any open neighborhood 
ffye boundary set dC, contained in A there exists a 

* See respectively <33) and i|56) for SO, (36) for / 2 , OS) and Oi for k and 
t37l for 'tpsat. 

^See successively 03, 03). 
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Strictly positive real number 5 such that, for any pair (f, if) 
of functions which satisfies 


first select a function k xW ^ W satisfying for 
all X in R” and all ( 1 /“,?/^) in 


i{x,u)-[f{x)+g{x)u] + C{x,u)-h{x) 


< 6 


y {x,u) € {Afg^)^xU{p) (12) 

the closed-loop system (H, (HB has equilibria and at any such 
point the output yr is zero. 

Proof: See Section IV-BI ■ 


If the domain of attraction were the full space, this result 
would follow from ll38l Section 12]. It says that, when the 
evaluation, on a “spherical shell”-like set, of the model and 
process functions are close enough, equilibria where output 
regulation occurs do exist. If this closeness is everywhere in 
the domain of attraction, then we have even a solution to the 
the well posed regulator problem with internal stability. 


Proposition 3 For any compact sets C and C, the latter being 
forward invariant for the closed-loop system which 

satisfy 

{ojcecec^, 

and for any open neighborhood of G, contained in A, 
there exists a strictly positive real number 5 such that, to any 
pair (^, (,) of functions which satisfies 


^{x,u) 


[f{x)-\-g{x)u] + C{x,u)-h{x) 


< 6 


y{x,u)eGa;Xll{fi) (13) 


and 




Vs*"’"' 

dC,( , 


< S 


dx 

{x) + ^ix)u 



dh 

0 ' 

V 

irA> 



\/{x,u) G xU{p) , (14) 


we can associate a point x^, = (xe,Zei^e) which is an 
exponentially stable equilibrium point of whose 

basin of attraction B contains G. Moreover, any solution 
{X{x,t),X{x,t),Z{x,t)) of ©, dnii with initial condition 
X in B satisfies 

(^X{x,t),'ijjsat (^X{x,t),z{x,t)^'^ = 0. (15) 

Proof: See Section IV-CI ■ 


This statement is of the same spirit as those claiming that 
under the action of (small) perturbations, asymptotic stability 
is transformed into semiglobal practical stability. But here we 
have more since we have existence of a single equilibrium for 
which the regulated output is zero. And for this no specific 
structure of the unmodelled effects is required. 


k{x,yr)=G> z/r = 0 , (16) 

\k{x,yr)-Kx,yr)\ < Lk(x)\y'^-yl\ , (17) 

where : R" —R>o is a continuous function. Of course 
the function k can be simply hr- But, in its choice, we can 
take advantage of the properties of the physical system under 
consideration and it can simplify the feedback design or its 
implementation. An example is given in section |VT] For the 
time being note that smoothness of k and (fThl l implies 

8k 

— (x,0) = 0 VxGR" (18) 

ax 

and the existenc^^ of a continuous function g : R>o — R>o 
satisfying p(0) = 0 and 

\yr\ < [l-\-\x\-\-\yr\^]g{\k{x,yr)\) V(x,yr) e R”xRP . 

(19) 

Actually the function k used in the output feedback (fTTT i is 
the modified version given later in (1391 ). 


B. Design the function via forwarding 
Let us consider the extended system 


X = f{x) -\- g{x)u, z = k{x,hr{x)) . (20) 


With Assumption |2] we are left with modifying the given state 
feedback to obtain a state feedback stabilizing asymptoti¬ 
cally the origin for the extended system ( l20l i. Fortunately it 
has the so-called feedforward form which has been extensively 
studied in the 90’s with in particular the introduction of the 
forwarding techniques based on saturations as in HOl or on 
Lyapunov design with coordinate change as in or coupling 
term as in Il22l . We recall briefly these techniques. They 
differ on the available knowledge they require. Specifically, 
Assumption IB has two consequences : 

1. With the converse Lyapunov theorem of lIZTl . we know 
there exists a function V : S R>o which is positive 
definite and proper on S and such that the function x M- 

-^{x)(^f{x) -I- g{x)P{x)^ is negative definite on S and 
upperbounded by a negative definite quadratic form of x in 
a neighborhood of the origin. 

2. Since the origin of the system I© in closed-loop with /3(x) 

is locally exponentially stable, there exists (see lf30l Lemma 
IV.2]) a function H : S satisfying 


dH 

dx 


(x) (/(x) -f p(x)/3(x)) 


k{x, hr{x)) , H{0) = 0. 

( 21 ) 


Depending on whether or not we know the function V and/or 
the function H or only its first order approximation at the 
origin leads to different designs. 


a) Forwarding with V and FI known 


III. State Feedback Design 
A. Adding an integral action: design of the function k 

To solve the problem of regulating yr to 0 we follow the 
very classical idea of adding an integral action. To do so we 


^When LgDjhr{x) = 0, for i in {0, ...,p}, {16) can be relaxed in 
|/c(3:, hr{x)) = 0, Lfhr{x) = ... = hr(x) = o| ^ hr(x) = 0. 

See (37) for example. 

'^The function 77 is a smoothened version of s —>■ 

I^rl 

l+|a;| + |j/rP ' 
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When both V and H are known, a stabilizer tjj for the 
system (l 20 l l. is 

ipix,z) = (22) 

l3{x) - J [LgV{x) -{z- H{x)Y LgH{x)Y^ , 

with H defined by (1^ . and with J : R" x R™ —)• K™ 
any continuous function satisfying, for all x € M", 

u^J(a;,u)>0 VuT^O, det 0)^ 7 ^ 0. (23) 

Following ll^ this can be established under Assumptions 
| 2 ] and |3] with the function 14 : 5 x R'’ —^ R>o defined as 

Veix,z) = V{x) + i(z - H{x))^{z - H{x)). (24) 

Remark 1 IfVis known from the design of (3, it may not 
be proper on S. To make it proper we first define vs as 

Vs = inf V{x) 
x^S 

and we replace V(x) by ■ See [32]. Unfortunately 

in doing so, the domain of definition of this new function 
V may be a strict subset of S. In the following, we still 
call S this domain on which V is proper. 


with J : R® X R™ — 7> R'" bounded and satisfying ( |2^ and 
e is a small enough strictly positive real number. 

Whatever design route a), b) or c) we follow, we obtain the 
following lemma. 

Lemma 1 Under Assumptions |2] and |5] the function I 4 A 
positive definite and proper on S X R"". Its derivative along 
the extended system m in closed-loop with u = 'ip{x,z) 
is negative definite on S x W and upperbounded by a 
negative definite quadratic form of {x, z) in a neighborhood 
of the origin. Consequently, for the corresponding closed loop 
system, the origin is asymptotically stable with S x W as 
domain of attraction (without forgetting Remark\I]l and locally 
exponentially stable. 

Proof: Since V is positive definite and proper on <S, 14 
is positive definite and proper on 5 x R’'. Also the derivative 
of 14 along the solutions of the closed oop system is negative 
definite in (x,f}(x,z)) and upperbounded by a negative def¬ 
inite quadratic form of (x,ip{x, z)) in a neighborhood of the 
origin (see 1^ . BOl for example). With this, to complete the 
proof, it is sufficient to show the existence of a real number 
c such that 

|z| < c|?/>( 0 ,z)| . 

Since we have 


b) Forwarding with V unknown but H known 

When V is unknown, but H is known, there exists a 
function 7 : 5 —R>o with strictly positive values such 
that a state feedback for the system ( l20l i is 

'0(x, z) = ^(x) + y{x)LgH{x)^ J(x, z — H(x)), (25) 

with H defined by d^ . and J : R" x R’’ —>• R’’ 
bounded and satisfying (l23t . This can be established with 
the Lyapunov function (l24l) . 


c) Forwarding with V unknown and H approximated 

Instead of solving the partial differential equation (|2T]) for 
H, and using ( l25l l, we pick 


'il){x, z) = (3{x) + 'y(x)g(x)^H q^ J(x, z — Hqx) , (26) 
where Hq is obtained as 


dk , dhr 


dx 


( 0 ) 


.s(0)f(0) 


(27) 


The corresponding Lyapunov function is 


14(x, z) = d{V (x)) + \Jl + \(z- HqxY (z - Hqx)- 1, 

where d : R>o —>• R>o is a function with strictly 
positive derivative, to be chosen large enough (see ll^ l. 
In the case where the system 


i = fix) + g{x){(3{x)-\-v), (28) 


with V as input is input to state stable with restriction, i.e. 
provided |?;| is bounded by some given strictly positive 
real number A, then following POl , the state feedback 
can be chosen as 


ipix, z) = I3{x) + e J ( X, 


5(0) 


^H^iz - Hox)\ 


(29) 


ip{0,z) = J{0,LgH{0)z) , respectively = J{0,Hogi0)z) 


where the function J satisfies (|2^ . the above inequality holds 
if LgH{0), respectively Hog{0), is right invertible. But, by 
differentiating (1211 1 which holds at least in a neighborhood of 
the origin, using ( fTSl ) and (l27T i. and since / and /3 are zero at 
the origin, we have 


dH 

dx 


( 0 ) = Ho 


Assume the matrix Hog{0) is not right invertible, i.e. the exists 
a vector v in R’' such that 


v^HogiO) = 0 . 


Then we have 

which contradicts Assumption [3] 


S(0) 

^(0) 



Remark 2 

■ Because the set lA in Assumption Q] is star-shaped, while 
satisfying ( 1251 ). the function J can always be chosen such 
that that the function above defined takes values in lA. 

■ A drawback of the integral action is the possible wind-up. 
To prevent this phenomenon, in all the above, z can be 
modified in 

z = k{x,yr) -\-LO [satg{z + iT(x)) — (z + iT(x))] (30) 

with i7(x) replaced by HqX when needed and where the 
saturation function is defined in ([7]), oj is any strictly pos¬ 
itive real number and z should be chosen large enough to 
allow the z-dynamics to converge to the right equilibrium 
point. This modification does not change anything to the 
asymptotic stability which can be established with the 
same Lyapunov functions. 
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C. Definitions of SO and fj, and saturation of tp to get the 
function ipsat 

If we were to design a state feedback, we could stop here. 
But the output feedback we design is based on the previous 
state feedback and augmented with an observer. Since the 
estimated state may make no sense during some transient 
periods, we need a mechanism to prevent any bad closed- 
loop effects during these periods. As proposed in 1^ . we use 
saturation. 

First we define the set SO where we would like the state 
to remain. For this, let S be given by Assumption |2] maybe 
modified as explained in Remark [1] above. Similarly, let O be 
given by Assumption [T] (maybe modified later as in (fS^I. Let 
also the function I 4 , positive definite and proper on 5 x K.’’, be 
given by the above design of the state feedback or a converse 
Lyapunov theorem USD satisfying 

Ve{x,z) 

dV 

= + 9 ix)ipix, z)] + ^{x, z)k{x, hrix)) 

= -We{x,z) (31) 

where the function We defined here is positive definite on 
5 X R’'. Then, if S is not a subset of O, we let Voo be the 
real number defined as 

Voo = inf Ve(x,z) . (32) 

(2;,z)e(5xR^)\(C'xR'-) 

If not let formally Voo be infinity. We define the open se|3 

iSH = {(x, 0 ) G 5 X K’’ : I4(a;, z) < Voo} • (33) 

This set in non empty since it contains the origin. 

In the same way, to each real number v in [0,Voo) we 
associate the set 

fiy = {{x, z) G 5 X R’’ : Ve{x, z) < v} . (34) 

It is a compact subset of SO. Also, from Lemma [T] it is 
forward invariant for the extended system (l20l l in closed-loop 
with u = ipix, z). On the other hand, for any Cxz, compact 
subset of SO, we can find real numbers Vi < V 2 satisfying 

c cn^^cgo. (35) 

Then, with /r the real number defined as 

/r = (l-|-^) max z)|, (36) 

{x,z)G r2v2 

with a small number as in ([TJ, we consider the subset 14 (p.) C 
14 (see (|4]l). As 14 in Assumption [T] it is star-shaped with the 
origin as a star-center. Let then the function ipsat ■ R" x R'’ —>■ 
W(p) be 

ipsat{x,z) = satf_,{'ip{x,z)) . (37) 

It is bounded and Lipschitz and, as ip, it is on a neigh¬ 
borhood of the origin. Similarly, we modify the function k 
(defined in (fTbl l) by saturating its argument x. Namely we 
replace 


k{x,h{x)) by 

fc(sat 5 ;(x), hr{x)) 

(38) 

where 

X = (1 

max |d::| . 

{x,z)G Ov2 

(39) 


IV. Observer Design 

In the Assumption[T]we ask for the knowledge of the family 
of observers ©. Fortunately it can be obtained as a high gain 
observer. A lot of attention has been devoted to this type of 
observers and many results are available at least for the single 
output case. See for example the survey ll2^ and the references 
therein. We are interested here in some specific aspects as 

(a) the possibility of writing the dynamics of the observer in 
the original coordinates; 

(b) the multi-output case; as far as we know at the time 
we write this text, the study of tunable observers in the 
multi-output case is far from being conclusive. Only some 
sufficient conditions are known (see, for instance Q, m, 

ED, El, 0, El, 0); 

(c) the fact that observability holds only on O, a (possibly) 
strict subset of the full space R". 

To introduce them, we find useful to start with a very brief 
reminder on single output high gain observers. 

A. Reminder on high gain observers in the single output case 

It is known (see ifTsl Theorem 3.4.1] for example) that, for 
a single-input single-output system of the form 

X = f{x) + g{x)u , y = h{x) , x G R", w, y G R , (40) 

which is observable uniformly with respect to the input and is 
differentially observable of order no, there exists an injective 
immersion $ : R" —>■ R"“, obtained as 

(/) = <l>(x) = ^/i(x) Lfh(x) ••• L'J‘’~^h{x)^ , (41) 

which puts the system (l40l i into the so called observability 
(triangular) normal form 

f=An„(p + BnM4')+Dn„(.(p)u, y = Cn„(p (42) 
where 

A _ I Ono — lxl ^no — lXno — l\ o _ /Orio —lxl\ 

" V 0 Olxno-l J’ [ 1 J’ 

Cno = (1 Olxno-l) , 

Dno{(p) = {dl{(pl),...,di{(pi,...,(pi),...,dnM)Y 

(43) 

and where h{-), di{-) are locally Lipschitz function. An ob¬ 
server for the system (l40l i is 

0 = An^(p + Bn„b{(p) + 

+Kn„Lr,^my - CnJ), (44) 

X = 

where Kn„ is such that {An„— Kn^Cn„) is Hurwitz, Ln^{i) = 
diag(£,..., and is any locally Lipschitz left in¬ 

verse function of $ satisfying 

= X VxGR”. 

In the (/(-coordinates it is a standard high gain observer the 
dynamics of which can be made arbitrary fast by increasing 
the high-gain parameter £ (see for instance 0). 


^See the further modification lED 
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B. On the possibility of writing the dynamic of the observer 
in the original coordinates 

As already observed in ll29l . a main issue in implementing 
the observer (ii is about the function for which we 

have typically no analytical expression, meaning that we have 
to solve on-line a minimization problem as 

X == argmin^|(/)(a;) - f\. 

Fortunately as noticed in im and proposed also in ||2^ . this 
difficulty can be rounded when $ is a diffeomorphism. Indeed 
in this case f is simply another set of coordinates for x and 
the observer (l44l l can be simply rewritten in the original x 
coordinates as 

x = f{x)+g{x)u+\^^-^{x)j Kr,Ln{e){y - h{x)). (45) 

As a consequence there is no need to hnd the inverse mapping 
of the function $ but, (inhnitely) more simply, only to invert 
9$ 

the matrix -—(x). But for $ to be a diffeomorphism, we need 

t/X 

Uo to be equal to n, i.e. to have the (full order) observer to 
have the smallest possible dimension. 


C. High gain observer in the multi-output case 

As shown in BD, in the multi-input multi-output case (|2]i, 
a typical expression for 4) is 

^{x) = (4'i(x) ••• , 

^^{x) = Lfhi{x) ••• L^fhi(x)) , 

(46) 

where hi is the i-th component of h and pi are integers called 
the observability indexes and Pi ^ The dynamics of 
system © expressed in these coordinates is 

(p = A(j) -f Bb{4i) -f D((j})u , y = Cf (47) 

where 

A = blckdiag (Ap, ,...,ApJ , 

B = blckcol {Bp^,... ,Bp^) , 

C = blckrow [Cp^ ,...,Cp^) , 

h{4>) = {hi{4>),...,bp{4>))^ , 

D{(t>) = blckcol (Dpi (<))),..., Dpp (</))) , 

where &(</)) and D(^) are locally Lipschitz functions. How¬ 
ever, even when the system is observable uniformly in the 
input, the functions b and D may not have the triangular 
structure we need for the design of a high-gain observer. 
Conditions under which we do get triangular dependence for 
h{<p) and D{(j)) have been studied for instance in © and 
im. Going on along this route and imposing $ to be a 
diffeomorphism (in order to write the observer in the original 
coordinates, as done in (l45T l). an alternative condition under 
which we do have an appropriate structure is given by the 
following (technical) assumption, for which we do not need 
to know the inverse of $. 

Assumption 4 There exist 


i) an open set O C K." containing the origin and a star¬ 
shaped set lA with the origin as star-center, 

ii) a function $ : O —^ K", 

Hi) sequences of matrices Li G Mi G and Nt G 

a matrix C G RP""”, 

iv) matrix functions u GlA K(u) G R"^p and u GlA 
A{u) G R”""", 

v) and, for any positive real number u, there exist a positive 
definite symmetric matrix P G R"^" and strictly positive 
real numbers v and d, 

such that 

01) the function $ is a diffeomorphism on the set O and 

$( 0 ) = 0 , 

02) C <l>(x) = h{x) , 

03) the matrices A(u ), K(u ), P, C satisfy, for any u GlA(u), 

P{A{u) - K{u)C) + {A{u) - K{u)CyP < -2vP, 
A{u)Le = LiMiAiu) , NiCLi = C , 

04) the matrix Mi is such that MiP~^ is symmetric and 
satisfies 

lim X„,in{MiP~^) = -fcx) , 

^ + oo 

05) Ainax {LiMiP-^Lj) < X^in{MiP-^f , 

1 < Amin {LiMiP-^Lj) X^in{MiP-y. 

Moreover, for any compact set £ and £ satisfying 

£ C £ C O 


there exists a sequence of positive real numbers Ci such that 
06) lim a = 0 , 

07) the function B : R"^™ R" defined as 

i?($(x), w) = L/$(x) -f Lg^{x)u — Aiu) $(x) , (48) 
satisfies, for all Xa G €, Xb G € and u GU(u). 


piMf^LJ^ [D($(xn),u) - Bmxb),u)] 


< Ci 


P^Lf^ [$(Xn) - $(X6)] 


(49) 


Remark 3 

■ As shown in the next Lemma, the existence of a high-gain 
observer for the system 0 is guaranteed if Assumption 
m holds. In particular the properties 01, 02, 03, 06 and 
07 guarantee the existence of a converging observer in 
the original coordinates whereas properties 04 and 05 
assure its tunability property. 

■ We remark that these conditions can be checked without 
need of finding formally the inverse mapping In par¬ 
ticular, given a system and a candidate diffeomorphism <i> 
(property 01), one can immediately check properties 02 
(linear dependence of the diffeomorphism on the output) 
Then, if this properties holds, one can fix the degrees of 
freedom K (u). Mg, Ng, Lg, P which properly defines the 
high-gain observer as shown later in Lemma^(see ( I501 l) 
and check also the Lipschitz condition (ill) in 07. Finally, 





property 03 guarantees the convergence of the observer 
(see proof of Lemma \2i. 

■ The conditions of Assumption^are satisfied in the single¬ 
output case considered in Section l/V-AI when Uo = n, by 
choosing $ as in (ED, and picking 

Li=diag , Me = i, Ng = 1 

A{u) = An, B(<P(x), u) = Bnb{^{x)) + Dn{^{x))u, 

and C = Cn, where the triplet An, Bn, Cn and the 
functions b(-), Df) are given in (143b . In this case, we set 
Ln{^) = LfMiNi and K{u) = Kn in the observer (144b . 

• In this assumption A is allowed to be input-dependent to 
allow a broader class of nonlinear systems. For instance 
it can be verified that the system 

Xi = X 2 , ±2 = u, y = —Xi -\- X 2 xl , 

can not be transformed in the form Elll but it satisfies 
Assumption |4] 

• In some cases, the nonlinear terms (@8]) can be disre¬ 
garded in the high gain observer design (usually also 
called dirty derivative observer). This is possible for 
example when the notions of observability indexes and 
relative degree indexes coincide (see sm among others). 
In this case, these nonlinear terms act through their bound 
and not their Lipschitzness. Unfortunately then a very 
specific structure is needed because otherwise the gain 
between these nonlinear terms and some estimation error 
is increasing with the observer gain. Here we intend to 
consider a broader class of systems and thus we do need 
to have these terms present in the observer. 

Lemma 2 Under Assumption @ for any compact set € and tL 
satisfying 

€ C € C O , 


the family of systems 


XI = f{xi)Fg{xt)u+ LiMiK{u)Ni[y-h{xi)] 

(50) 

indexed by £ in R>o satisfies points 2 to 6 of As sumption\I\ 
Proof: We let 


4>=<^{x), (j3l = ^{xi), = (51) 

With (|48]l and (gOll, systems dD and ( l50b are transformed in 

f = A{u)4> + B{(j), u) 

fie = A(u)fe + B(fe, u) + LeMiK{u)NiC{4> - fit) 

With Assumption |4] and the notations (ISD . we define the 
Lyapunov Function 

Ui{x,x) = - fieV[LeMiP~^{(j) - fi) . 

As 4), it is defined on 0x0 and it takes values in R>o. Also, 
because the matrix LiMiP~^Lj is positive dehnite, we have 

V(a:, Xi) €0x0, Ui{x, Xi) = 0 x = xi . 

So point 2 of Assumption [D holds. Also we get 


Ui{x, x) = (f- (j)e)^[L^ ^PMe ^]x 


(52) 


X {A{u) - LiMiK(u)NiC){(j) - fi) + B{4>, u) - B{(j>i, u) 

which, with using 03 and ( l49b , gives, for all (x, a;) in (T x £, 

ile < + ci\P^Lf^ft\^(l + |m|) . 

Then, with 06, for any |m| < u, there exists a i such that, for 
any i > £, 

IT T —T O 7- —1 ■ 


Ui{x,x) < PL} 


y{x,x) e (T X £ . (53) 

Since we have 

P > Xmin{P)Xmin{MiP-^) PMf^ , 

we obtain, for all {x,x) in £ x £, 

TT : ^ V X.aiin{P)Xm\n{AIlP ^ 

Ui(x,x) < -^- Ui{x,x) . 

So, with 04, points 4 and 5 of Assumption [D hold when we 
choose the integer k as the integer part of the ratio £/£ and 
with 

^ '^min (P)A7nin(M^P-l) 


Next, we have 

Ui{x,x)Xniin {LiMiP~^Lj) = 


fj (LiMiP-^Lj)-^ 




A7„i„((LrM^P-iL7)-i) 

< Ut.(x, x) Ainax (LiMiP~'^Lj ) 


So, with 05, we get 

Ui(x, x)Amin (MeP~^)~‘^ 

< |$(x) < Ue(x,x)Xn,in{MeP-y. 

But, because $ is a diffeomorphism defined on O, for any 
compact subsets £ and £ of O, there exist real numbers $ 
and P$-i, independent of I, such that, for all a; in £ and xi 
in £, we have 

\x-X(,\ = |$“^(<i)(a;)) - 

< P$-i|<i)(a;) - 4>(a;^)| < $. 


This gives 

|a;< Ut{x,x) 

< $ X^in{MiP-y. 

So, with 04, point 3 of Assumption [D holds. 

Finally, point 6 of Assumption [D holds too. Indeed, by 
dehnition of the set U{u), the matrices K{u), Mi, Ni, Li and 
the diffeomorphism $, there exists a positive definite function 
Pi}i{xi) such that 



-1 

LiMiK{u)Ni 


— P'd^ixf) 


for any £ > 0, u €U{u) and Xi € £. 
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D. Taking care of observability restricted to O by an observer 
modification 

In the above dU, we are missing point 1 of Assumption [T] 
namely € may not be forward invariant. The problem is that 
the observer (fSTl l does not guarantee that xi remains in O and 
therefore that is invertible. To round this problem, as 

in 1291 . we modify this observer, here not by projection, but by 
considering a dummy measured output (extending the results 
in ISj). To make our point clear, we introduce the following 
assumption. 


that we choose to keep an Euclidean distance in the 
image by ^ as a Lyapunov function for studying the 
error dynamics. Also we need an infinite gain margin, 
as defined in Definition 2.8 in mi, since the correction 
term must dominate all the other ones in the expression of 
X when /i 2 becomes too large. Then as proved in Lemma 
2.7 m, with such constraints, the convexity assumption 
is necessary. This implies that, if we want to remove the 
convexity assumption, we have to find another class of 
observers. 


Assumption 5 Given the set O and the dijfeomorphism <1> of 
Assumption |4] for any compact subset £ of O, we know of a 
function h 2 '. O ^ ]R>o such that: 

HI. the set {x € K” : h 2 {x) < 1} A a subset of O; 


H2. the function x i—>■ , is continuous on O; 

H3. for any real number s in [0,1], and any xi and X 2 in O 
satisfying 


h 2 {Xl) < S , h2{X2) < s , 


we have h 2 {x) < s for all x which satisfies for some 
A in [0,1] 


$(a;) = A<i)(xi) + (1 - A)<i)(a;2) . 

This means nothing but the fact that, for any s in [0,1], 
the image by $ of the set {x G R" : h 2 (x) < s} is 
convex; 

H4. the set Omod defined as 

Omod = {x&W^ : h 2 {x) <Q} (54) 

contains £ and has a non empty interior which contains 
the origin; 

H5. the set 

£ = {a; G M" : |h2(a;)| < i} 


is compact. 


Remark 4 

■ There is a systematic way to define this function /12 when, 
given the compact set £, we know a positive definite 
symmetric matrix Q and a real number R satisfying 

$(£) C {(/) G M” : <R} C 4>(0) . 

Indeed, in this case we let g be the number defined as 


g = sup R . 


Since O is a neighborhood of the origin, g is strictly 
positive. Then we select a real number e in (0,1) and let 


h 2 {x) = max 




-e,0 


(55) 


With this choice and since $ is a diffeomorphism, we can 
check that Properties HI to H5 are satisfied. 

We may dislike the convexity property mentioned in H3 of 
Assumption\^ Unfortunately it is in some sense necessary. 
Indeed our objective with the modification E is to pre¬ 
serve the high-gain paradigm. This means in particular 


We are interested in the function ^2 because it satishes the 
property 

h2{x)=0 'ix&Omod- 

This leads us to introduce a dummy measured output 

y2 = h2{x) . 

Indeed j /2 is zero when x is in Omod- But Omod being a strict 
subset of O, we have here a stronger constraint. To deal with 
this restriction, we need to “reduce” the set SO by modifying 
its dehnition given in ( l3Tl into 

Voo = inf V{x,z) 

(a;,z)e(5xR’-)\(C>™odXR>') 

SO = {(a:,z) G (5 X K’') : V{x,z) <Vao} . 

With Assumption |5] point 1 of Assumption [T] can be 
established via a modihcation of the observer. 


Lemma 3 Assume Assumptions 0 holds. Let ^ : O ^ R" be 
a dijfeomorphism, u be a positive real number and t —^ u(f) 
be a continuous function with values in U (u) and t —>■ y(t) 
be a continuous bounded function. The set £ given in H5 is 
forward invariant for any system in the family, indexed by i 
in R>o, 


xt = f{xi) -\-g{xi)u 


(57) 


E{xe,u,y) 

where the term E is defined as 


E{xe,u,y) =-Te{xe,u,y)x (58) 

where is a function to be chosen large (see ^5% ). 

If all conditions of Assumption^ hold and the model state 
X remains in Omod, then all the points of Assumption Q] are 
satisfied. 


Proof: First we observe that 


^^{xe)xi= R{xg,u,y)-\- 
ox 


- n{xi) 




5$ 

dx 


{xi) 


-IT 


dh2 

dx 


{xty 


h2{X() 


where we have let 


R{xe,u,y) 


dh2 

dx 


(xe)x 
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X 


f{xe)+g{xe)u + 



LiMeK {u)Ni [y-h{xe)] 


This motivates us for choosing satisfying 


n{xe,u,y) > 


8 h 2 {xg)'^ R{xg,u,y) 




(59) 


which can be computed on-line. 

Thanks to H2, the function x i—>• Te(x) defined this way is 
continuous on O. So we can use rg as long as xg is in O. 


It implies that h 2 {xg) is non positive when h 2 (xg) is strictly 
larger than i. With uniqueness of solutions, this implies that, 
for each s in [^,1] the set {{xg) : h 2 {xg) < s} is forward 
invariant and so is the compact set € in particular. This says 
that point 1 of Assumption [T] hold. 

On the other hand, the modification E augments Ug in (l52l i 
with 


-Ti{xg) 



-IT 


dh 2 

dx 


{xg)^h 2 {xg) . 


But, when h 2 {x) is zero which is the case when the model 
state X remains in Omod and when h 2 {xg) is in [0,1], the 
convexity property of /12 in H3 gives 

0 < [$(t^) - $(x)]^ ^^{xgYh2{xg) . 

We conclude that, when all conditions of Assumption |4] hold, 
(I 53 I 1 holds even with the modification E. Hence, from the 
proof of Lemma|2] points 2 to 5 of Assumption[T]hold. Finally, 
with (ISST i and ( |59] |. the function defined by the right hand side 
of (I 57 I 1 satisfies also the point 6 of the Assumption [T] ■ 


Remark 5 An important feature is that, thanks to the addi¬ 
tional term E, no other modification (as saturation) is needed. 
This modification, in fact, guarantees that the estimate state 
Xg remains in a compact subset of O which depends on the 
choice of the parameters. 


V. Proofs of Propositions 
A. Proof of Proposition Q] 

This proof follows the same lines as in Q, inspired by lfT9l 
Chapter 12.3] with no meaningful no originality. We give it 
only for the sake of completeness. 

We introduce the notations 


Xe 




fei^ei Ue) 


{f{x) -\-g{x)ui\ 

k(u 2 ,hr(x)) ) ’ 


tpe{x,z) 


^{x,z)'^ 


fisateiXyZ) 


f 'll)sat{x,z)\ 
\^sats(T )) 


where the functions ij}, ipsat and satj are defined in Sections 
IIII-BI and IIII-CI The closed-loop system (|2|i, (fTTT i can be 
compactly written as 


Xe = fe{Xe,Ue) , Ue = fieix, z) . 


We have a function I 4 , positive definite and proper on 5 x R’’ 
which allows us to define the compact sets and Hvj, as in 


(|3^ and satisfying (l35T l. Also, with (1311 1 and (iJTT i. the function 

-We{x,z) = Ve(x,z) 

dVg dVe 

= -^{x,z)[f(x) + g{x)il}sot{x,z)] + -^{x,z)k(x,hr(x)) 

is continuous and negative definite on Hyj. 

These properties imply the following; 

1. there exists a positive real number W and a continuous 
function a : ]R>o —> [0, VF] such that 

dV 

■^{Xe)[fe{Xe,'fsate{x,z)) - fe{Xe,'tpe{x, z))] 

< a(\x — ccj) V(a:, z) G , Vx G K" ; 

2. there exists a strictly positive real number W such that 

dVe 

■^{Xe)fe{Xe,'fsate{x,z)) < -W 

\/(x,x,z) : (x,z) G \x - x\< S^w, 

where is the strictly positive real number defined as 
'1 


^xw — O; 


-1 


- min Weix,z) 

2 nv2 


By collecting this, we obtain 
dVe 

-^(Xe)fe(Xe,'fsate{x,z)) 


< —We{Xe) a(\x — x\) < W 

< -W 


V (x, z) G , V X G K”, (60) 


V (x, z) G Hv 2 \Hvi , X ■. \x — x\ < 5x 


(61) 


On another hand, let C = (Ov 2 )x- From (l34l i. it is a compact 
subset of O. With this set and p defined in (l36l l we can invoke 
Assumption [T] It gives us in particular the sequence cr^, the 
integer d, the real number U and the function a. This allows 
us to define the integer k as the smallest one satisfying 

exp Vk>k. ( 62 ) 

From now on, we fix k, arbitrarily but larger than k. 

Assumption [T] gives us also the functions '0^. and C/„ and 
the forward invariant compact subset € of O. Then, because 
Uk, is continuous and satisfies the point 2 of Assumption [T] 
there exist^ a class-/C°° function satisfying 

Uk{x,x) <aKi\x — x\) V(x,x)g£x£. ( 63 ) 

From € we define Cf and F as the sets 




F = £ X Hv 


( 64 ) 


Cx is a compact subset of O and F is a compact subset of 
O X Hvj. Since all the functions are Lipschitz on F, the 
solutions of the closed-loop system (fTTTi are well defined 

and unique as long as they are in the interior set F of F. 
Moreover their values satisfy inequalities dhOl l and (|6]l. Also 
since Cs = £ is forward invariant, the x-component of this 
solution cannot reach the boundary of this set in finite time. 

Stability 


® can be constructed from s 1 —)■ max 


{x,x)G €x€ : \x—x\<s 


U{x, x). 
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Let Nk., contained in f, be an open neighborhood of the 
origin whose points (a;, x, z) satisfy 

Ve{Xe) + a a„(|x - x|))) < y . 

Consider a solution of the closed-loop system, starting from an 
arbitrary point {x,x,z) in Let [0, T[ be its right maximal 

interval of definition when it takes its value in the open set L. 
To simplify the notation we add (t) to denote those variables 
which are evaluated along this solution. 

With (|6]l and (l6Tt we have 

U{x{t),x{t)) < aK(|x(0) - x(O)l) VfG[0,T[, 

a(|x(f) — x(f)l) < a'^U{x{t),x{t)) Vfe[0,T[. 

This implies 

\x{t) - x{t)\ < a“^(CT^a«;(|x(0) - x(0)|)) V f € [0 ,r[. 

(65) 

This inequality and dbOl l. where Wg is non negative, give 


Then, with ( IMT l and ( 1681 ), we obtain 


max 


|v;(x(f),z(f)), vij 


< 


max 




V2 - vi \ 
2W ) 


z 


/ V2 - Vl 

V 2 W 


Vl I < V2 

(70) 


for all t in Since Cx is forward invariant, this 

establishes that the solution cannot reach the boundary of T 
on [0,r[. This implies that T is infinite and that the solution 

remains in T for all t in ]R>o. So inequalities db^ and (fTOl) 
and therefore inequalities dbOl l. (|6| and (|8]l hold for all t larger 
than ■ With LaSalle invariance principle, we conclude 

lim Ve{x{t),z{t))+ U{x{t),x{t)) — 0. 

>- + oo 

and thus that the solution of the closed-loop system converges 
to the origin provided its initial condition (x( 0 ),x( 0 ), 2 ;( 0 )) is 
in Cx X rivi T) Cx X Cxz • ® 


Ve{x{t),z{t)) < v;(x(0),z(0)) 

-b a(a-i(cr^ a^(|x(0)-x(O)l))) <y 

VfG[0,r[. (66) 

Thus, if the initial condition (x(0), x(0), z(0)) is in Mk., 

the solution remains inside a strict subset of L. Hence T is 
infinite and from ( 1651 ) and ( 1661 ) we can conclude that the 
origin is stable. 


B. Proof of Proposition \2\ 

We denote 

AT = (x, Z, x) , 

( f{x) + gix)tpsat{x,z)\ 

Pm{x) = k{x,hr{x)) , 

\i}^{h{x),x,'ipsat{x,z))J (71) 

/ ^{X,1psatix,z) 

Pj,{x)=\ k{x,C,r{x,'fsot{x,z))) 

\di^{C,{x,'fsat{x,z)),X,'fsat{x,z)) 



Attractiveness 

Consider now a solution of the closed-loop system with 
initial condition (x, x, z) in Cx x Hvi which, according to dTSl ), 
contains C^ x Cxz- Let [0, T[ be the right maximal interval of 

definition of this solution when it takes its values in T. With 
(l8]l, (|6]) and dbOl) . we have, for all f in [0, T[, 

U{x{f),x{f)) < exp (—f) C/(x(0),x(0)) 

< exp (-cr^ t)aiU, (67) 

Ve{x{t),z{t)) < Ve{x{0),z{0)) -PWt<Vi + Wt. 


Since the x-component of the solution cannot reach the bound¬ 
ary of Cx in finite time and since T4(x(f), z{t)) is smaller than 
V 2 , we must have 


V2 — Vl 

T > _ 

W 


and 

K ( X 


V2 - Vl 

2W 




V2 - Vl 

2W 


, V2 + Vl 
< -- < V2 . 


( 68 ) 

Then, because n satisfies (l62l i. (l67l i and (|6]l give, for all t in 

a(|x(f) - x(f)l) < cr^C/(x(f),x(f)) < a{Sxw) 

and therefore 


VfG[»,r[. (69) 


A first elementary remark is that, if Xg = (xg, Ze, Xg) is an 
equilibrium point of ipp, then we have in particular 

0 = = fc(Xg, hr{Xe)) ■ 

With (fTbl l this implies /ir(xg) is zero. 

To prove the existence of x,., we use ifTbl Theorem 8.2] 
which says that a forward invariant set which is homeomorphic 
to the closed unit ball of K" contains an equilibrium. The 
Proposition [1] gives us a forward invariant set, which may not 
be homeomorphic to the closed unit ball. So our next task is 
to build another set satisfying the required properties. 

The equilibrium of 


L = pmix) (72) 

being asymptotically attractive and interior to C which is 
forward invariant, C is attractive. It is also stable due to the 
continuity of solutions with respect to initial conditions uni¬ 
formly on compact time subsets of the domain of definition. So 
it is asymptotically stable with the same domain of attraction 
A as the equilibrium. It follows from ||4^ Theorem 3.2] that 
there exist C°° functions V : A ^ ]R>o and : A ^ K>o 
which are proper on A and a class /Coo function a satisfying 

a{\x\)<V{x), L(0) = 0, 

a{d{x, C)) < V-q{x) , V-q(x) = 0 \/x G G , 

^{x)(prnix) < -V{x) VxGA, 
^(x)(p^(x) < -V^(x) 


|x(f)— x(f)| < (5; 


Vx e A . 
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Since C is compact and Mqq is a neighborhood of its boundary, 
there exists a strictly positive real number d such that the set 
{x G A'. d{x, C) G (0, d]} is a subset of Then, with the 
notations 

T./ N C((d) 

= sup_ _V[x} , > 

xGA:d{x,e)<d 

and since a is of class ICoo, we obtain the implications 


for the system ( ISTT i. With IfTO Theorem 8.2], we conclude that 
this sublevel set contains an equilibrium of this system. 

Finally, from points 1 and 6 of Assumption[T] we know that, 
even when the observer in ([n]l is fed with y = ((x,u) and 
not with h(x), it admits a forward invariant compact subset £ 
of O. So with 

L = sup{La^(x),Lk(x)} 

xec 


VQ(x) + wV(x)=a(d) => a(d(x, G)) <Vq(x) <a(d) , 
=> d(x, G) < d , 

^ V{x) <Vq . 

With our definition of w, this yields also 

a(d) - w V{x) = V^ix) ^ 0 < ^ < V^(x) , 

0 < d(x, G) ^ d , 

^ x€Arg^\G. (74) 

On the other hand, with the compact notation 

V(x) = Vq(x) + 'ujV(x) , 

we have 

^(x)^Pm{x) < -V{x) VxgA. (75) 
ox 

All this implies that V is a Lyapunov Function for (l72l i on A 
in the sense of Il42] Page 324] and that the sublevel set {x £ 
A : V{x) < a(d)| is contained in U G. It follows from 
ll42l Corollary 2.3^3 that the level set {x £ A : V(Ar) = a{d)} 
is homeomorphic to the unit sphere. But, with the fact that the 
origin is asymptotically stable and the arguments used in the 
proof of ll42l Theorem 1.2], this implies that the sublevel set 
{x £ A : V{x) < Q;((i)} is homeomorphic to the closed unit 
ball. 

Then, since the set 


C = {x £ Mqq : d{x, G) £ [0,d]} 
is a compact subset of Afg-^ C A, the real number 

dV, 


G = sup 
x^C 


dx 


X 


(76) 


is well defined and strictly positive. We get, for all x in C, 


— (x)lfip(x) = —(x)(p^(x) + ^(x)[ipp(x) - ipm{x)\ , 

< -V(a’) + G sup \ipp{x) - (fm{x)\ . 
xgC 

So, if ipp satisfies 

\^p{x) - ^ra{x)\ < Vat G A/gg , (77) 

we have, for all x in {x £ A : V{x) = a{d)} 
dV 1 

This implies the compact sublevel set {x : V(a’) < Qf(d)} 
is homeomorphic to the closed unit ball and forward invariant 


^Thanks to the contribution of Freedman (m and Perelman f3T1 the 
restriction on the dimension is not needed. 


with given by (|9]) and (x) given by ( fTTb . we have, for 

all (a;, z, x, u) in R." xWxGxU, 


\ipp(x) ^pm(x)\ 

< ^{x,u) — [f{x)-\-g{x)u] + 2L (^{x,u) — h{x) 

Hence dTTl l holds when (fT^ is satisfied with 
1 inf;^gc'"^('^) 


(5 = 


1 + 2L 


2 sup 


xgC 


dV 

a;'") 


C. Proof of Proposition |5] 

We start with the following Lemma which combines total 
stability and hyperbolicity and is a variation of ll^ Theorem 
6 ]. 


Lemma 4 Let a G^ function ifm '■ R" ^ R" be given such 
that the origin is an exponentially stable equilibrium point of: 


A- = (fimix) 


(78) 


with A as domain of attraction. For any compact sets G and G, 
the latter being forward invariant for the above system, which 
satisfy 

{0}cececA, 

there exists a strictly positive real number 6 such that, for any 
G^ function pp : R" -£ R" which satisfies: 


Pmix)\ ^ 5, 


dpp . , dprn 
dx dx 


(^) 


<-5, 


Vat g G, (79) 

Vx £ G, (80) 


there exists an exponentially stable equilibrium point Xf. of: 


X = <pp{x) , (81) 

the basin of attraction of which contains the compact set G. 


Proof: Let If be a positive definite symmetric matrix and 
a a strictly positive real number satisfying 

n^(o) + ^(o)^n < -an, A„,i„(n) = i, 

dx dx 

where Amax and A„iin respectively stand for max and min 
eigenvalues. By continuity there exists a strictly positive real 
number po such that we have, for all x satisfying x^Ilx < po , 


n^(^)^^(^)Tn<_Ln 


dx 


“l 

2 


and 


x"^Xlipm{x) < -A'^HA’. 
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Let (/?p : K” ^ R" 
Wp{^) ~ ^m{x)\ < 


be any function satisfying 

- / yx-x^ux = 

4V 12A„,,x(n)’ ^ • 6 


Eh 

6 ■ 

(82) 


We obtain 

X^nipp^x) = X^Tiipmix) + X^^[Pp{x) - ipm{x)\, 
< X^Wipmix) + -X^WX 


+ \(pp{^x') cpjyii^X^^ II[ipp(A:’) 


and therefore 


A'' T\Lpp{x) < --^x ' Hat, Mx ■. x' Hx = ^ . (83) 

In this condition, it follows from ifTbl Theorem 8.2] that, 
for each function tpp satisfying ( l82l i. there exits a point x,, 
satisfying 

ipp{x,)=Q, (XefnXe<^. (84) 

Assume further that (pp satisfies 

a 


dipp dipm, s 


dx 


dx 


< 


8Aniax(n) 


'ix ■. x' liX < Pq. 


(85) 


In this case, we have, for all x satisfying IIa' < pq, 

T 

n 




dpp ^ , _ dprn 
dx ^ dx 


ix) 


+ n 


, dpm, 


dx 


ix) + 


dx 


(a’) ' n + n 


< --n . 

- 4 


dpp dpr, 


- a. 




Note also that we have 

iT 


[Xe + s(x - Xe)] n[A'e + s(a’ - Xe)] < PO , 

V(a, Ae, s) : S € [0, 1] , {XeYnXe < ^ , X^T\X < 

D 6 


Then, with 


P 1_ o 

Pp{x)=Pp{x)-pp{Xe)=J -^{Xe + S{x-Xe))ds[x-Xe] 

and (l84l i. we get, for all a satisfying a^IIa < 

[X - Xepnpp{x) = 

J - A'e]^n^^(A:’e + s{x - Xe))[x - Xe]^ ds, 


Let 


< --[X - Xeyil[x - XeJ . 


Si = min < — 


PO 


4 V 12A„,ax(n) ’ 8An,ax(n) 

and reduce po if necessary to have that x satisfying 
(Are)^nA'e < po is in 6. Then (f79b and dSOl) with (5 = i5i 
implies (l8^ and therefore (l84l) . We have established that the 
system dSTI) has an exponentially stable equilibrium with basin 
of attraction containing the compact set {x S M" : a'^IIa’ < 

po 1 

.3 J- 


Now, with d and V = Vq+ wV as defined in the proof of 
Proposition |2] we let v be a strictly positive real number such 
that we have 

x^Ux < ^ WxgA: V{x) < y (86) 

Let also 

C = {xGA:y_< V{x) , d{x,e) € [0, d]} 

It is a compact subset of C A. By mimicking the same 
steps as in the proof of Proposition |2] we can obtain that, if 
Pp satisfies 

\pp(x) - P^(x)\ <, Vx€e (87) 
we have 

^{x)pp{x) < -^V(a) Va e C . 

This implies the compact set {x € A : V(a') < v} is asymp¬ 
totically stable for the system dsTT l with basin of attraction B 
containing the compact set {x G A : V{x) < a{d)} which 
contains C. Since, with (l86l l. we have 

{xgA: V{x) < v} C € R” : x^Ux < y 

with ( |82] |. (1851 ), and ( l87b we have established our result with 
S given as 


(5 = min^ 


Po 


inf 


x&C 


Vix) 


4V 12A„,ax(n)’8A„,ax(n)^ 


2 sup 


x&C 


dx 


(X) 


Proof of Proposition |5} In view of the above Lemma 
and ( fT9b . Proposition [3 holds if ( flBl l and (fT4l) imply ( l79b and 
At the end of the proof of Proposition |2] we have seen 
that (fOl) implies ( iTgb . So we are left with proving that (fT3l) 
and (O imply (IHOl l. By using again the notations (1711 1 and by 
dropping the arguments we see that 


dpp! ^ dp< 


dx dx 


ix) 


< 


|Am(Ap - A„)A„| + |(A2 + A2i)A „)|\Ay 


where 



A 2 = 


A„ = 


A^, = 


A 


0 

d^tpsat 


0 ' 

dip sot 


dz dx 
(df ^ dg 

V ° 


/ 0 

d^k dhj. 
dyp: dx 

dH^ dh 
\ dy"^ dx 


d'^k 

dxf 

dH, 
ddf J 





> 

to 

11 

0 

0 

d^d. 


dvf t 


Ay = C(x, ipsatix, z)) - h{x). 

Recall that by construction the functions ipsat, k and r? are 
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C^. Hence, by letting (where the arguments are dropped for 
compactness) 


Lfci? = sup 

{x,z,x)^^ 


Lq, - 


= sup 

{z,x)^{Q^ 


L2k — 

sup 


{x,z,x)^Q 

L2-& = 

sup 


{x,z,x)^Q 

and L 2 

= max{L; 


dk 


dyr 




dy 


dtps, 


dz 


dtps, 


Lh = sup 

xe(e)i 


dx 


d^k 


dyl 

dH. 


d^k 


dy^ 


dx^ 

d^d 


dv? 


dHs 


dxP' 


dh 


dx 


d^P,. _ dvm 
dx dx 


(^) 


< 


'^LuLk-d |Ap — Ami + 2 ^ 2(1 + Lu + Lh) |Ajj 


The proof can be completed by using (fOT l and (fT4l i in place 
of Ay and (Ap — Am) and by properly defining 6. ■ 


VI. Illustration of the Proposed Design via the 
Longitudinal Model of a Plane 

As an illustration we consider a non academic but still very 
simplified model of the longitudinal dynamics of a fixed-wing 
vehicle flying at high speed, given (see CD, 1331) by 

V = e —psin( 7 ) 

P ■ ta \ 5COs(7) 

7 = X^;sin(6' —7)-(oo) 

V 

0 = q 

where v is the modulus of the speed, 7 is the path angle, 9 
is the pitch angle, q is the pitch rate, g is the standard gravi¬ 
tational acceleration and £ is an aerodynamic lift coefficient. 
This model makes sense for v strictly positive only. 

The problem is to regulate 7 at 0, with v remaining close 
to a prescribed cruise speed vq, using the pitch rate q and the 
thrust e as controls, and with 7 and 9 as only measurements. 
So here, by using the notation introduced in Section |II] 

x = {9,j,v), u = {e,q), y = {9,'y) , j/r = 7 • 


A. Choice of the function k in the integral action 
We select 

k{x,h{x)) = usin(7) . 

The motivation is that, then the integrator state z has the same 
dynamics as the altitude of the vehicle (not taken into account 
in this illustration). 


B. State feedback design 

To design the state feedback tp and the associated Lyapunov 
function 14 , we start by noting that the so called phugoid mode 
is conservative (see for instance |[3 Section VIL4]). Precisely 
we have that the following function remains constant along 
the solutions when e = 0 and sin (0 — 7 ) = 

3 

= TT- 

Sug Vq 


This can be checked by looking the time derivative of X. Also 
the open sublevel set of I 

f V I 

is the largest sublevel set not containing a point of the type 
(0,7). Namely it is the largest sublevel set of X where the 
model dSSl) is well defined. Moreover in this set the 7- 
component of any point is in (—f,f)- Also X is positive 
definite in v—vg and 7 on S. We conclude that T-l-|, restricted 
to iS is a candidate for playing the role of a Lyapunov function. 
Also forwarding with the functions V and JI known is possible 
since when e = 0, the function 

Z - ff(v) = 

2g 

remains constant along the solutions of the following (z, v)- 
subsystem 

z = V sin(7) 

V = e — g sin(7) . 

Finally we can complete the design of a state feedback by 
applying backstepping from the fact that 9 given as 

0 = 7-1- arcsin 

is stabilizing for the (z, u, 7)-subsystem. 

All this leads to the following (weakj^ Control Lyapunov 
function 



Tw \ 2 V , , fci 

y{z,v,-f} = ^-f--cos (7 -b — 

Sug O Vg 4 


2gz + v'^ — vl 


2 


0 — 7 — arcsin 


(/ugOj 


1 2 


(89) 


where the dimensionless numbers ki and ^2 are arbitrary but 
strictly positive, and the following feedback law 


e 


-satfc^ 



cos(7) + ki 


2gz + v‘^ — Vg V 

Vg Vg 


q 


/ £v^sm{9-j)-g v^ • / \ , 9 COs{j) 
- 7 -VI— 3 Sin( 7 )H- 

\0-7-arcsin(^j v 


— £v sin (0 — 7 ) -b ^4 


— 7 — arcsin 



where kg and k^ are dimensionless arbitrary strictly positive 
real numbers and k^ and kq are arbitrary strictly positive sat¬ 
uration levels. With LaSalle invariance principle it is possible 
to prove that ( 11 , 7 , 0 ) = 0 , arcsin is the only 

asymptotically stable equilibrium point of the system dSST l. In 
this simple illustration we have chosen the simpler Lyapunov 
Function dS^ . but it does not give enough degrees of freedom 
to improve performance and increase the domain of attraction. 
More appropriate designs are possible by choosing different 
Lyapunov functions (see 1321). Finally, according to Section 


*Its derivative along the solutions may be only non positive. 
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IlII-CI for its use in the output feedback, the state feedback 
law q above has to be modified by adding a saturation (see in 
particular the function ip sat in (ITTI) )- 


C. Design of the high-gain observer 

To obtain an observer we check that the conditions of As¬ 
sumptions |4] are satisfied. Let 'jdot be defined as the following 
function 

Idot ( 6 », 7 , u) = iJu sin( 6 > - 7 ) - 

V 

Then let 


= ^(2;) = {(pl,(p2,(p3) = 

It is defined on the set 



{d,^,Jdot{6,7,v)) . 

X (0; + 00 ) , 


and ( 0 , 7 ,w) can be recovered from its values {(pi,(p 2 j(p 3 ) in 
the following subset of <i)(Cl) 


S = {<^ G : </>! G I) , </'2 G (- 

(p 3 < - 2 ^Jg£\(pi - (p2\ if (01 


TT 7r\ 

2’27 ’ 

- 02) < 0| . 


Note also that d^/dx is always non-singular on the set O 
because d'ydot/dv cannot be equal to 0 when 0 G S. Hence 
the function $ is a diffeomorphism satisfying Assumption Ol. 
Then, with C defined as 


C = 


0 0\ 

1 oj’ 


Assumption 02 also holds. 

Now let A, B, Li, M( and Ni be defined as 



fo 

0 

o\ 

Li 

= diag(l,l,f) 

A = 

0 

0 


Mi 

= diag(^,.(,£) 



0 

oj 

Ni 

= diag(l,l), 


B{^{x),u) = col ( Ml, 0, Ml 


80 
dffdot _ 

d"f 


~^dot 


d"ido 

dv 

djdot 

dv 


U 2 


gsin(7) 


Also, given any strictly positive number i/, let P be a sym¬ 
metric positive definite matrix defined as 


P = 


* 

* 

P23 



where 2p23 < —VP 33 - Then there exists a real number p such 
that we have 


D. Design of the correction term 

Following Section HV] the function h 2 {x) can be defined as 

^2(21) = h\{x) h\{x) -\- h\(x) h^ix) 

with 

hl(x) = max|^ - ei;o|, h'^{x) = max|^ - e2;0|, 

^ 2 ( 2 ;) = max jea (0 - 7 ) - 'jdot - £ 4 ; o|, 

fi4(ai)=inax{^f^-e5;0}, 

where ei, £ 2 , £ 3 , £ 4 , £5 and jdot max are constants to be prop¬ 
erly chosen. The functions /i 2 ,i and ^ 2,2 take care respectively 
of 9 and 7 to stay in the set S as showed in Figure [T] whereas 
functions /i 2,3 and ^ 2,4 take care of f{9,^,v) as in Figured 
The correction term E is defined as in Lemma [3 Finally 
the functions and cr^ can be defined as in the proof of 
Lemma |2l 



PA + P - pC^C < -vP . 

This implies the existence of a real number Vk such that, for 
any Vk>Vk, with 

K = VkP~^C^ 

assumptions 03 to 07 are satisfied. 

^We use \<j>i — <f> 2 \ to upper bound cos02 sin( 0 i — 02). 


VII. Conclusions 

Robust asymptotic output regulation by output feedback has 
been investigated. Our design technique follows the very usual 
approach of stabilizing the origin of the model augmented 
with integrators of the output errors. To do so we assume we 
have already a stabilizing state feedback for the model but not 
asking for any specific structure nor for normal form nor for 
minimum phase. For the augmented model we redesign the 
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State feedback by applying forwarding. The output feedback 
is obtained by introducing a high-gain observer expressed in 
the original coordinates. The output regulation is shown to 
be robust to any small enough (in a sense) unstructured 
discrepancy between model and process in open loop. 

In establishing our main propositions we obtained new results, 
which may have their own interest. They concern high-gain 
observers for multi-output systems (Lemma |2]l and persistence 
of equilibria under small perturbations (Proposition |2]i. 

The design we propose is illustrated by the regulation of the 
flight path angle for a simplified longitudinal model of a plane. 
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